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FINITE COMPOSITE GAMES: EQUILIBRIA AND DYNAMICS 


SYLVAIN SORIN AND CHENG WAN 


Abstract. We study games with finitely many participants, each having finitely many choices. 
We consider the following categories of participants: 

(I) populations: sets of nonatomic agents, 

(II) atomic splittable players, 

(III) atomic non splittable players. 

We recall and compare the basic properties, expressed through variational inequalities, concerning 
equilibria, potential games and dissipative games, as well as evolutionary dynamics. 

Then we consider composite games where the three categories of participants are present, a typical 
example being congestion games, and extend the previous properties of equilibria and dynamics. 
Finally we describe an instance of composite potential game. 


1. Introduction 

We study equilibria and dynamics in finite games: there are finitely many “participants” i € / 
and each of them has finitely many “choices” p € S l . The basic variable describing the strategic 
interaction is thus a profile x = {x l , i € I}, where each x l = { x p , p € 5*} is an element of the 
simplex X 1 = A (S l ) on S l . Let X = ]\ l&I X l . 

We consider three frameworks (or categories): 

(I) Population games where each participant i £ I corresponds to a population: a nonatomic set 
of agents having all the same characteristics. In this setup x p is the proportion of agents of “type 
p" in population i. 

The two others correspond to two kinds of /-player games where each participant i G I stands 
for an atomic player: 

(II) Splittable case: x l p is the proportion that player i allocates to choice p. (The set of pure 
moves of player i is X 1 .) 

(IH) Non splittable case: x p is the probability that player i chooses p. (The set of pure moves is 
S l and x l is a mixed strategy.) 

As an example, consider the following network where a routing game of each of the three 
frameworks takes place. Assume that arc 1 and arc 2 are connecting o to d. 


arc 1: m 



arc 2: 1 


First, in a population game, consider two populations of agents going from o to d. Suppose 
that a proportion x\ of population 1 is taking arc 1 while the rest of the population (x\ = 1 — x\) 
uses arc 2, and similarly for population 2. 
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Next, in the splittable case, consider two players who both have a stock to send from o to d 
and can divide their stock. Suppose that player 1 sends a fraction x] of his stock by arc 1 and 
the remaining (x^) by arc 2, and similarly for player 2. Finally, in the non splittable case, still 
consider two players having to send their stock from o to d. However, they can no longer divide 
their stock, but have to send it entirely by one arc. Suppose that with probability x\ player 1 
sends it by arc 1 and with probability x\ he sends it by arc 2, and similarly for player 2. 

In all cases, the basic variable is x £ X, defined by (x];,x 2 ) € [0, l] 2 . 

Assume, more specifically, that the two participants are of size ^ each and that the congestion 
is m on arc 1 and 1 on arc 2, if the quantity of users is rn £ [0,1]. Then it is easy to check that 
the equilibria are given by: 

- in framework I, x\ = x 2 = 1: all the agents choose arc 1; 

- in framework II, x j x 2 - both players send | of their stock on arc 1 where rn = 

- in framework IE. the set of equilibria has one player choosing arc 1 (say x\ = 1) and the other 
choosing at random with any x 2 £ [0,1]. 


2. Description of the models 

2.1. Framework I: population games. 

We consider here the nonatomic framework where each participant i £ I corresponds to a popu¬ 
lation of nonatomic agents. 

The payoff (fitness) is defined by a family of continuous functions {F p , i£/,p£S'*} from X to 
M, where Ff(x) is the outcome of an agent in population i choosing p, when the environment is 
given by the basic variable x. 

An equilibrium is a point x £ X satisfying: 

x* > 0 => Fp(x) > Fj(x), Mp, q £ S\ Mi £ I. (1) 

This corresponds to a Wardrop equilibrium [35] , 

Proposition 2.1 (Smith [26], Dafermos 51). 

An equivalent characterization of m is through the variational inequality: 

(F i (x),x i -y i )> 0, My i £ X\Mi £ /, (2) 

or alternatively: 

(F(x),x-y)=J2(F i ix),x i -y i )> 0, My £ X. (3) 

i£l 

A special class of population games corresponds to games with external interaction where each 
F l depends only on x~ l . 


2.2. Framework II: atomic splittable players. 

In this case, each participant i £ I corresponds to an atomic player with action set X 1 . Given 
functions F p as introduced above, his gain is defined by: 

= (Anu) = £*#(*). 

p£S l 


In other words, it is the weighted average gain of all fractions x l p allocated to different choices p. 
An equilibrium is as usual a profile x £ X satisfying: 

H\x) > H\y\ x _i ), Vp* £ X\ Mi £ /. 

Suppose that for all p £ S l , Ff(-) is of class C 1 on a neighborhood fl of X, so that 

dH l 


d: 


-(x) = Fp(x) + 


dF l a 

— —r- (x). 
.2 V J 


qeS { 


'd 


xt, 


( 4 ) 
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Let V* H l (x ) stand for the gradient of H l (x l , x *) with respect to x l . Then by a classical opti¬ 
mization criteria [H] one has: 

Proposition 2.2. Any solution of satisfies 

( VH(x), x-y) = VLFT(x), x i - y l ) > 0, VyG X. (5) 

i&I 

Moreover, if each H 1 is concave with respect to x l , there is equivalence. 

Variational inequalities characterizing Nash equilibrium in atomic splittable games (Haurie and 
Marcotte m) and those characterizing Wardrop equilibrium in nonatomic games have different 
origins. Inequalities in © for a Nash equilibrium are obtained as first order conditions, while 
inequalities in © for a Wardrop equilibrium are derived directly from its definition. 

2.3. Framework IE: atomic non splittable. 

We consider here an I- player game where the payoff is defined by a family of functions {G l , i€l}, 
all from S = ILe/ S l to R. We still denote by G the multilinear extension to X where each 
X 1 = A(S' 1 ) is considered as the set of mixed actions. 

An equilibrium is a profile x G X satisfying: 

G i (x i ,x~ i ) > G i (y i ,x~ i ), Vy* G X i , Vz € I. (6) 

Let VG l denote the vector payoff associated to G l . Explicitly, VG‘ p : X~ l —>• R is defined by 
VGp(x ~ l ) = G l (p,x~ q ’), for all p G S l . Hence G l {x) = (x l ,VG l (x~ 1 )). 

An equilibrium is thus a profile x G X satisfying: 

(VG(x),x-y) = Y J ( yG\x- i ),x i -y i ) > 0, Vy G X. (7) 

iei 

2.4. Remarks. 

Frameworks I and III have been extensively studied. Framework III corresponds to games with 
external interaction, but the multilinearity of VG l (x~ l ) will not be used in this paper. 

Note that F, XH and VG play similar roles in the three frameworks. This can be seen from 
the three variational characterizations of equilibrium: ©, © and ([7]) . 

We call F, XH and VG evaluation functions and denote them by in each of the three 
frameworks. 

From now on, we consider the following class of games which includes (i) population games 
where Ff are continuous on X for all i and p, (ii) atomic splittable games where H l is concave 
and of class C 1 on a neighborhood of X 1 for all i, and (iii) atomic non splittable games. A typical 
game in this class is denoted by T(4>), where <f> is its evaluation function. 

Definition 2.1. NE($) is the set of x G X satisfying: 

($(x),x-y) > 0, Vy G X. (8) 

NE($) is the set of equilibria o/T(<f>). 

The next result recalls general properties of a variational inequality on a closed convex set. 

Theorem 2.1. Let C C R d be a closed convex set and T a map from C to R rf . 

Consider the variational inequality: 

(T(x),x — y) > 0, Vy G C. (9) 

Four equivalent representations are given by: 

T(x) G N c (x), (10) 

where Nc{x ) is the normal cone to C at x; 

T(x) G [Tdx)^, 


( 11 ) 
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where Tq(x) is the tangent cone to C at x and [Tc(x)]- 1 - its polar; 

n T c (a:)^(®) = 0, (12) 

where II is the projection operator on a closed convex subset; and 

IIc[s + T(x)] = x. (13) 

Proof. (\E , ( x),x — y) > 0 for all y G C is equivalent to T(x) G Nc(x). Hence, 'F(x) € [Tc(x)] 1 - 
and n T (a:) ^(x) = 0 by Moreau’s decomposition [T7] . 

Finally the characterization of the projection gives: 

(x + T(x) — n c [x + 'F(x)], y — n c [x + T(x)]) <0, \/y G X. 

Therefore, n c[x + ’F(x)] = x is the solution. □ 

Note that this result holds in a Hilbert space. 

3. Potential and dissipative games 

3.1. Potential games. 

Definition 3.1. A real function IT, of class C 1 on a neighborhood Ll of X, is a potential for $ 
if for each i G I, there is a strictly positive function pd(x) defined on X such that 

(\/ i W(x) - //(x)$*(x), 2 /) =0, Vx G X,My* G X l 0 , Mi G /, (14) 

where Xq = {y G Ml 5 "!, YlpeS^p = *-*} the tangent space to X 1 and V* denotes the gradient 
w.r.t. x*. 

The game r(<3?) is then called a potential game and one says that 4? derives from W. 

Some alternative definitions of potential games have been used such as: 

= h\xW P (x) - 4>*(x)], Vx G n, Mp, q G S i (15) 

or 

9 = p\x)$ l p (x), Vx Gtt,MpG S\ (16) 

Remark that ([TUI) yields (TTUl) . and (TTUl) implies that the vector {— p l <S> l p (x)} p€S i is propor¬ 
tional to (1,..., 1), hence is orthogonal to Xq, thus (fTXl) holds. 

Sandholm ED defines a population potential game by (fIBl) with m = 1 for all i. 

Monderer and Shapley m define potential games for finite games, which is equivalent to our 
definition (1151) in framework IE. 

Proposition 3.1. Let r(4>) be a game with potential W. 

1. Every local maximum ofW is an equilibrium o/r(4 ) ). 

2. IfW is concave on X, then any equilibrium o/r(4>) is a global maximum ofW on X. 

Proof. Since a local maximum x of W on the convex set X satisfies: 

(VW(x),x — y) >0, My G X, (17) 

it follows from (flD) that (/d(x)4>*(x), x 1 —y % ) >0 for all i and all yGX. This further yields (|8|). On 
the other hand, if IT is concave on X, a solution x of (1171) is a global maximum of IT on X. □ 
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3.2. Dissipative games. 

Definition 3.2. The game T($) is dissipative if T satisfies: 

($(x) -4>(y), x - y) < 0, M fx,y) £ X x X. 

It is strictly dissipative if 

($(x) — 4>(y), x — y) < 0, V (x, y) £ X x X with x ^ y. 

In the framework of population games, Hofbauer and Sandholm [T2] introduce this class of 
games and call them “stable games”. 

Notice that if T is dissipative and derives from a potential W, then W is concave. 

The set of equilibria in dissipative games has a specific structure (see Hofbauer and Sandholm 
[12 . Proposition 3.1, Theorem 3.2]) described as follows. 

Definition 3.3. SNE (4>) is the set of x £ X satisfying: 

($(y),x -y)> 0, Vy € X. (18) 

Proposition 3.2. 


SNE(§) C JVE7($). 

7/T(4>) is dissipative, then 

SNE(<S>) = NE($). 


Corollary 3.1. If is dissipative, NE(<&) is convex. 

A strictly dissipative game T(<f>) has a unique equilibrium. 


The description is more precise in the smooth case. 

Proposition 3.3. Suppose that <1? is of class C 1 on a neighborhood Pi of X. Denote by J$(x) the 
Jacobian matrix of & atx, i.e. J$(x) = ((-j-f) q& s:)p£S i ' Then, dissipative implies that J<j>(x) 
is negative semidefinite on Tx(x), the tangent cone to X at x. 

Proof. Given x £ X and z £ Tx(x), there exists e > 0 such that x + tz £ X for all t €]0, e]. Hence 
(4>(x + tz) — $(x),x + tz — x) <0, which implies that z ) < o. Since is of class 

C l , letting t go to 0 yields (J$(x)z, z) < 0. □ 

Definition 3.4. Suppose that is of class C 1 on a neighborhood Pi of X. The game r(4>) is 
strongly dissipative if J$(x) is negative definite on Tx(x). 


4. Dynamics 

4.1. Definitions. 

The general form of a dynamics describing the evolution of the strategic interaction in game T(4>) 
is given by: 

x = B$(x), x £ X , 

where X is invariant, so that for each i £ I, B$(x) £ Xfi 

First recall the definitions of several dynamics expressed in terms of 4>. 

(1) Replicator dynamics (RD) (Taylor and Jonker [31] ) 

Xp = x\,[%{x)-W {x)}, p£S i ,i£l , 

where 

$*(*) = (x\$ l (x)) = x^pix) 
peS i 

is the average evaluation for participant i. 
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(2) Brown-von-Neumann-Nash dynamics (BNN) (Brown and von Neumann [2], Smith |27J.2D|, 
Hofbauer [IT]) 


id p = $* - s* J 2 % P £ S\i e I, 
q£S l 


where = [4>* (x) — < h i (.x)] + is called the “excess evaluation” of p. (Recall that [f] + = max{t, 0}.) 


(3) Smith dynamics (Smith) (Smith [25]) 

= ^^[^(x)-d>*(x)] + -4^[<h*(x)-^(.T)] + , p€S i ,i€l, 

qeS i qeS i 

where \d> l p {x) — <Tg(x)] + corresponds to pairwise comparison (23] , 

(4) Local/direct projection dynamics (LP) (Dupuis and Nagurney [5], Lahkar and Sandholm m) 

i € I, 

where T X i(x l ) denotes the tangent cone to X 1 at x l . 

(5) Global/target projection dynamics (GP) (Friesz et al. |6j, Tsakas and Voorneveld m) 

x i = U X i[x i + ^(x)]-x\ i G I. 

Recall that the two dynamics above are linked by: n r ^ [4>®(x)] = lim^oA - $ -■ 

(6) Best reply dynamics (BR) (Gilboa and Matsui [?]) 

x i G BR i (x) — x®, iel, 

where 

BR\x) = {tf G X\ (i y i - z\<S>\x)) > 0 ,Vz i G X 1 }. 


4.2. General properties. 

We define here properties expressed in terms of 4>. 

Definition 4.1. Dynamics £>$ satisfies: 

i) positive correlation (PC) (Sandholm [21] ) if: 

{Bi(x),^ i (x)) >0, Vi G /,Vs G X s.t. & 9 (x) /0. 

(This corresponds to MAD (myopic adjustment dynamics) (Swinkels [30] J: assuming the config¬ 
uration given, an unilateral change should increase the evaluation); 

ii) Nash stationarity if: 

for x G X, Bq>(x) = 0 if and only if x is an equilibrium o/r(<l>). 

The next proposition collect results that have been obtained in different frameworks. We 
provide a unified treatment with simple and short proofs. 

Proposition 4.1. (RD), (BNN), (Smith), (LP), (GP) and (BR) satisfy (PC). 
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Proof. 

(1) RD (Sandholm {25, .23]): 

= £ 4[$‘(x) -r(x)]<6‘(z) 

peS* 

= >j(x)-r(x)] 2 + ^xj[^(x)-r(x)]r(x) 

pe5 i pe5 i 

= X] ^p[ $ p( x ) -^(®)] 2 + [ X x p $ p( x ) $V) 

peS* peS i 

= X x p[ $ p( x ) - $ l (®)] 2 ^ °- 

peS i 

The equality holds if and only if for all p € S l , x p [4>*(x) — 4>*(x)] 2 = 0 or, equivalently x p [4>*(x) — 
<f>*(x)] = 0, hence B\,(x) = 0. 

(2) BNN (Sandholm [2TJ 221123] , Hofbauer 1.1]j: 

<si w, ®‘w> = E - 4 E = E - E E 

pG5 i q£S 1 PCS* peS i qeS * 

= x %(xw P (x) - x ^{x)W{x) = x ^(®) [<w - *V)] 

p&s 1 qeS i peS i 

= E(®j,w) 2 > ». 

pGS i 

The equality holds if and only if for all p € S l , 4>p(x) = 0, in which case B$(x) = 0. 

(3) Smith (Sandholm [251 [23] ): 

<*<*).**(*)> = E (E - *lw] + )*lw - E 4«i<*) E (♦',(*) - ®lwi + 

peS i qeS i peS i qes* 

= E^iwww - *lw] + - E4*lw[*lw - *K*)] + 

p,q q,p 

= E i W*l( i )-®iw] + ) 2 so. 

p,q 

The equality holds if and only if for all q G S l , either x l q = 0 or (x) > $ l p (x) for all p G S l , in 
which case B$(x) = 0. 

(4) LP (Lahkar and Sandholm [15] . Sandholm [24]): Recall that, if N X i(x l ) denotes the normal 

cone to X 1 at x l (the polar of T X i(x *)), then for any v G M 5 ’: v = n r + n A r^ i: (, T qu and 

( n T fi ( x^v — 0 (Moreau’s decomposition, ||17j ). Thus, 

(BUx),&(x)) = <n Tjfl(xi) [^(x)],^(x)> = <n Tjf . {xi) [& (x)], u Tx . {xi) [$* (s)] + . {xi) [$* (x)] ) 

= ||n Txi(a;i) [^(x)]|| 2 >o, 

and the equality holds if and only if n r ( X »)[$ r (x)] = 0, i.e. B$(x) = 0. 

(5) GP (Tsakas and Voorneveld [52]): Let z = x + $(x). Then, 

(B^(x),^(x)) = <n X i{z i )-x\z i ~xf) = (n X i {?) -x\z i - U X i{?) + U X i(z { ) - x l ) 

= -<x 4 - n xi (z i ),z i - n xi (/)> + l|n Yi (^) - * 4 || 2 
> ||n X i(« i )-x < || 2 >o. 
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The second last inequality holds since x 1 £ A l , thus (x l — IT X i(z*), z l — D X i(z 1 )') < 0. The equality 
occurs in both inequalities if and only if x l = Ii x -,.{z l ), in which case B$(x) = 0. 

(6) BR (Sandholm [23]): 

(Bi(x),<f>\x)) = {y* - x\&{x)) >0 

since y l £ BR l (x). The equality holds if and only if x z £ BR l {x ), hence B$(x) =0. □ 

Proposition 4.2. (BNN), (Smith), (LP), (GP) and (BR) satisfy Nash stationarity on X. 

(RD) satisfy Nash stationarity on int X. 

Proof. 

(1) BNN (Sandholm [21, [22, 23]) : x £ NE(<&) is equivalent to: 3>p(x) = 0 for all p £ S. Hence 
£>$(x) = 0. 

Reciprocally, assume the existence of i £ I and p £ S l such that &p(x) > 0. Since there exists q 
with x q > 0 and & q (x) = 0, one obtains B\ q (x) < 0, contradiction. 

(2) Smith (Sandholm [231E3]) : Assume x £ NE(&). Then for all i £ I and q £ S\ either x q = 0 
or 4>g(x) > 4>p(x) for all p £ S l . Hence £>$(x) = 0. 

Reciprocally, assume the existence of i £ I and p £ S l such that x l p > 0 and [<!T (x) — 4>p(x)] + > 
0. Choose such a p with smallest 3>l(x) then one obtains B 1 ^ p {x) < 0. 

(3) LP (Lahkar and Sandholm [15], Sandholm [23]): The result follows from (fl2l) . 

(4) GP (Tsakas and Voorneveld [32]): The result follows from (fl3l) . 

(5) BR (Sandholm [23]): By definition B$>(x) = 0 if and only if x l £ BR‘(x) hence x £ NE{<&). 

(6) RD (Sandholm [231 23]): Assu m e x £ int A' fl NE(<&). Then, 4>*(x) = W(x) for all i £ I and 
p £ S l and thus £>$(x) = 0. 

Reciprocally, if x £ int A and £>$(x) = 0, x is equalizing hence in NE(f&). □ 

4.3. Potential games. 

We establish here results that are valid for all three frameworks of games. 

Proposition 4.3. Consider a potential game r(4>) with potential function W. If the dynamics 
x = £>$(x) satisfies (PC), then W is a strict Lyapunov function for B§. Besides, all ui-limit 
points are rest points ofB$>. 

Proof. Consider x £ X. Let {x t }t> o be the trajectory of £>$ with initial point xq = x, and 
Vt = W(xt) for t > 0. Then 

V t = (VW(x t ),x t ) = Y J ( y i W{x t ),x\) = Y J B i {x){<t>\x t ),x\) > 0. 

i&I i&I 

(Recall that xt £ Aq.) Moreover, (<& l (xt), x\) = 0 holds for all i if and only if x = B$(xt) = 0. 
One concludes by using Lyapunov’s theorem (e.g. |13l Theorem 2.6.1]). □ 

This result is proved by Sandholm [21] for the version of potential games in framework I defined 

by ([H]). 

It follows that, with the appropriate definitions, the convergence results established for several 
dynamics and potential games in framework I or III extend to all dynamics and frameworks. 
Explicitly: 

Proposition 4.4. Consider a potential game T(4>) with potential function W. 

If the dynamics is (RD), (BNN), (Smith), (LP), (GP) or (BR), W is a strict Lyapunov function 
for £>$. 

In addition, except for (RD), all ui-limit points are equilibria o/T(4>). 
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4.4. Dissipative games. We apply also for this class the previous “dictionary” used for potential 
games and dynamics. 

Proposition 4.5. Consider a dissipative game r(4>). 

(1) RD: Let x* € NE/I>). Define \ T7\: 

m*)-Z E 

iel p£supp(x **) p 

Then H is a local Lyapunov function. 

//r(4>) is strictly dissipative, then H is a local strict Lyapunov function. 

(2) BNN: Assume C 1 on a neighborhood LI of X. Define [27, 29l fIT] : 

i<£l p£S' 

Then H is a strict Lyapunov function which is minimal on NE(fi>). 

(3) Smith: Assume $ C 1 on a neighborhood LI of X. Define [28] : 

h{x) = y. E 4{i4w-4w] + } 2 ' 

i£l p,q£S l 

Then H is a strict Lyapunov function which is minimal on NE{fi>). 

(4) LP: Let x* € NE(&). Define HEIGH, 19] : 

H{x) = ~ ||x — x*|| 2 . 

Then H is a Lyapunov function. 

//r(4>) is strictly dissipative, then H is a strict Lyapunov function. 

(5) GP: Assume 4> C 1 on a neighborhood LI of X. Define [20] : 

H(x) = sup {y-x,$(x)) -\\\y-x\\ 2 . 
yex 2 

Then H is a Lyapunov function. 

7/r(4>) is strictly dissipative, then H is a strict Lyapunov function. 

(6) BR: Assume 4> C 1 on a neighborhood LI of X. Define [12lj : 

H{x) = sup(y — x, <l?(x)). 
yex 

Then H is a strict Lyapunov function which is minimal on NE(&). 

The proof is in Apprendix. 


5. Example: congestion games 

An eminent example of the games studied in this paper is a network congestion game, or 
routing game. The underlying network is a finite directed graph G = {V, A), where V is the set 
of nodes and A the set of links. The vector 1 = ( l a )aeA denotes a family of cost functions from M 
to M + : if the aggregate weight on arc a is rri, the cost per unit (of weight) is Z a (m). 

The set I of participants is finite. A participant i is characterized by his weight rn l and an 
origin/destination pair ( o l ,d l ) € V x V such that the constraint is to send a quantity m l from 
o* to d l . The set of choices of participant i £ I is S l : directed acyclic paths linking o* to d l and 
available to i. Let P = U* eiS 1 . 

Assume that, for all arcs a € A, the function l a is continuous and finite on a neighborhood U 
of the interval [0, M] and positive on U f~lR+, where M = aggregate weight of the 

players. 
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In each of the three frameworks considered in this paper, a participant is respectively a popula¬ 
tion of nonatomic agents (I), an atomic splittable player (E) and an atomic non splittable player 
(IE). Thus, in framework I, a fraction x p of population i takes path p\ in framework E, x p is the 
proportion of the weight m l sent on path p by player i ; in framework IE, x p is the probability 
with which player i take path p. The basic variable x is a profile of strategies of the participants 
and the corresponding set is X = 

In frameworks I and E, a strategy x l induces a flow f l on the arcs (or simply flow ) for each 
participant i. Explicitly, the weight on arc a is /* = Y2, P GS i p^a m *x p . Define the aggregate 
configuration z = (z p ) p gp, where z p = Xue/ S i 3 P ' m *x p . The aggregate flow is f = (f a )aeA, with 
fa = Xas/ /* the aggregate weight on arc a. Notice that f can also be induced by the aggregate 
configuration z. Denote f~ l = f a — /*. 

Given an aggregate configuration z and aggregate flow f , the vector of congestion on the arcs 
is 1(f) = {G(fa)}aeA- This specifies now the cost of a path p by c p (z) = I] aep G(fa)- The 
corresponding vectors are c l (z) = ( c p (z)) p&S i for i € /, c(z) = (c*(z))j e /, and l l ( f) = 1(f) for 
all i € /. In particular, path costs c p and arc costs l a are determined only by the aggregate 
configuration or the aggregate flow. 

The evaluation functions in the first two frameworks are respectively: 

I: population: &' p (x) = — c p (z). 

E: atomic splittable: <5 p (x) = — du d Y , where u l (x) is the cost to atomic player i: 

Ax) = (A Ax)) = Y 4c p ( Z ) = no = D]T/* i„(f„). 

p€S i a&A 

In framework IE, first consider the arc flow / and aggregate arc flow f induced by a pure- 
strategy profile s: f a (s) = YZxgi fa( s ) and fa( s ) = Yi*l aesl . Then the evaluation function is 
<hp(x) = —VUf(p,x~ l ) = —U l (p,x~ l ), where 

u i (x)= 

sSTljzI & j£l a£s l 


Congestion games are thus natural settings where each kind of participants occurs. However 
one can even consider a game where participants of different natures coexist: some of them being 
of category I, E or IE. This leads to the notion of composite game which is introduced in full 
generality in Section 6. Consider here a simple example where there are three participants in the 
network: population 1 of nonatomic agents of weight m 1 , atomic splittable player 2 of weight 
m 2 , and atomic non splittable player 3 of weight m 3 . Suppose that their basic variables are 
x 1 = (x p ) pe gi, x 2 = (x 2 ) qe g2 and x 3 = (% 3 )seS 3 respectively. Here x 1 and x 2 describe pure 
strategies while x 3 specifies a mixed strategy. 

Let us first look at the pure-strategy profiles. Given a pure strategy s € S 3 , let x = ( x 1 ,x 2 , s), 
f(x) be the induced aggregate flow: f a (x) = Y ip eS 1 , P 3 a mlx p + T, q es 2 ,qBa m2x l + m3l {aes} and 
z the induced configuration. The corresponding cost of a path p is c p (z) = Yl a & P la(fa( x ))- 
Therefore the cost to an agent in population 1 using path p (if x p > 0) is c p (z) for all p € S 1 , the 
cost to atomic splittable player 2 is u 2 (x ) = Ylq&s 2 x q c q(. z )i an ^ the cost to atomic non splittable 
player 3 is u 3 (x) = c s ( z). 

Consider now a strategy profile x = (x 1 , x 2 , x 3 ). This induces a distribution on pure strategy 
profiles (x 1 , x 2 , s ) hence a distribution on the sets of aggregate distributions z s . The cost to each 
player is then obtained by taking the relevant expectation. Explicitly, for population 1, the cost 
to an agent in the population using path p (if x p > 0) is J^sgS 3 x s c P (z s ), while its evaluation 
function is <h 1 (x) = ( < h p (x)) pe 5 i where $ p (x) = — J2 s gS 3 x s c p( z s )• Tor atomic splittable player 2, 
his cost is u 2 (x) = YIsgs 3 x s Sges 2 x q c q( z s)i while his evaluation function is <L 2 (x) = (&q(,x)) q£ g2 



FINITE COMPOSITE GAMES: EQUILIBRIA AND DYNAMICS 


11 


where ^ . For atomic non splittable player 3, his cost is u 3 (x ) = ^2 sG g3 x 3 c s (z s ), 

while his evaluation function is 4> 3 (x) = (<h 3 (a;)),, eS 3 where 4> 3 (x) = — c s (z s ). 

Through this example, one can further see that congestion games are a natural example of an 
aggregative game (see [25j l where the payoff of a participant i depends only on x l G X 1 and on 
some Hxed dimensional function G A(M P ) (here the aggregate distribution induced by 

the participants —i). Because of the aggregative property of congestion games, one can show that 
accumulation points of flows induced by Nash equilibria for a sequence of composite congestion 
games, when the atomic players split into identical players with vanishing weights, are Wardrop 
equilibria of the ‘limit’ nonatomic game, i.e. the nonatomic game obtained where the atomic 
splittable players in the previous sequences games are replaced by populations of nonatomic 
agents. This result shows intrinsic link between the different frameworks discussed in this paper. 
The reader is referred to Haurie and Marcotte [lOj or Wan [33] for details. 

In framework II, v l is of class C 1 and convex when the arc cost functions satisfy a mild condition, 
as the following lemma shows [341 Lemma 29]. 

Proposition 5.1. In r(<3?), if each cost function l a is of class C 1 , nondecreasing and convex on 
U, for all arc a € A, then u l (x l , x~ l ) is convex with respect to x l on a neighborhood of X 1 for all 
fixed x~ l G X~ l . 


6. Composite Games 

6.1. Composite games and variational inequalities. 

We have seen that the properties of equilibrium and dynamics in the three frameworks all depend 
on the evaluation function <f> and the variational inequalities associated to it. Based upon this 
idea, let us define a more general class of games called composite games, which exhibit different 
categories of players. Composite congestion games with participants of categories I and II have 
been studied by Harker [ 8 ], Boulogne et al. [Tj, Yang and Zhang [36] and Cominetti et al. |3j, 
among others. 

Consider a finite set I\ of populations composed of nonatomic agents, a finite set I 2 of atomic 
splittable players and a finite set I 3 of atomic non splittable players. Let I = I\ U I 2 U I 3 . 

All the analysis of Sections 3 and 4 extend to this setting where x = and <L*(x) 

depends upon the category of participant i. 

Explicitly, there are finitely many “participants” i G I and each of them has finitely many 
“choices” p G S l . Vector x l = { x l p , pG S 1 } belongs to simplex X 1 = A (S' 1 ) on S l and X = ]/[;<=/ VL 
For i G /1 , the payoff Ff,p G S'* is a continuous function on X and 4>* = F l . 

For i G I 2 , Fp, p G S'* is a continuous function on X and the payoff H l (x ) = (x l ,F l (x)) is concave 
and of class C 1 on a neighborhood of X 1 . Then 

For i G I 3 , VGp is continuous on X~ l , the payoff is G l (x ) = ( x l , VG l {x~ 1 )) and = VG l . 

Let this composite game be denoted by r(4>). 

The main point to note is that the evaluation by participant i is independent of the category 
of his/her opponent (their evaluation functions 4> - *) hence the analysis of Section 2 implies the 
following. 

Proposition 6.1. x G X is a composite equilibrium of a composite game r(<l?) if and only if 

(4>(x), x — y) > 0, Vy G X. (19) 

An example of such a composite game is a congestion game with the three categories of par¬ 
ticipants in a network (see Section 5). 

6.2. Composite potential games and composite dynamics. 

Once the equilibria of a composite game are formulated in terms of solutions of variational 
inequalities, those properties of equilibria and dynamics based on such a formulation in the 
three frameworks discussed so far are naturally inherited in the composite setting. 
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The general form of a dynamics in a composite game r(4>) is again 

x = B$(x). 

The definitions of positive correlation and Nash stationarity for are exactly the same as in 
Definition 14.11 

Arguments similar to those for Propositions 14.11 and 14.21 show the following. 

Proposition 6.2. In composite game r(4>), composite dynamics (Smith), (BNN), (LP), (GP) 
and (RD) satisfy (PC) and Nash stationarity on X. 

(RD) satisfies (PC) and Nash stationarity on intX. 

The definition of a potential game and that of a dissipative game for composite games are 
analogous to those for each of the three frameworks. Note that the condition for each participant 
is independent of the others. Hence the corresponding properties of composite dynamics for these 
specific classes of composite games can be proved in the same way as for Propositions 14.41 and 
1431 

Definition 6.1. A composite game r(<3?) is a composite potential game if there is a real-valued 
function W of class C 1 defined on a neighborhood D of X, called potential function, and strictly 
positive functions fi 1 ,i £ I on X such that for all x € X, 

(VV(i) - // ; (x)4>*(x),?/) =0, Vx 6 X,Vy* € X l 0 , Vi € I, (20) 

where Xq = {y <5 Ml 5 '!, y p = 0} for all i € I. 

Proposition 6.3. In a composite potential game r( < h) with potential function W, if the dynamics 
x = £><j>(x) satisfies Nash stationarity and (PC), then W is a global strict Lyapunov function for 
Besides, all ui-limit points are rest points of B$. 

Corollary 6.1. A potential function W of a composite potential game r(<3?) is a global strict 
Lyapunov function for (RD), (Smith), (BNN), (LP), (GP) and (BR). 

Definition 6.2. A composite game r(4>) is a composite dissipative game if — 4> is a monotone 
operator on X. The game is strictly dissipative if — 4> is strictly monotone on X. 

Proposition 6.4. If a composite congestion game r(4>) is dissipative, then one can find Lyapunov 
functions for (RD), (Smith), (BNN), (LP), (GP) and (BR) as defined in Proposition \).5\ (with 
the assumption that 4> is of class C 1 for (Smith), (BNN), (GP) and (BR)). 

As a matter of fact, we can obtain results stronger than Proposition 6.1, Corollary 6.1 and 
Proposition 6.3 which consider only homogeneous dynamical models, i.e. where all the partici¬ 
pants follow the same dynamics. Looking more closely into the proofs for the results in Sections 
4.2-4.4, one can see that the results extend naturally to heterogeneous dynamical models where 
the participants follow specific dynamics. 

Basically note that the condition for positive correlation can be written component by compo¬ 
nent, hence it corresponds to a unilateral property: it depends only for each participant i on the 
evaluation 4?* and the dynamics B\ = B'( yj . For example, in a composite potential game, as long 
as each of the dynamics followed by different participants satisfies (PC), the potential function 
is a strict Lyapunov function. Because of this unilateral property, the dynamics in this paper 
belong to the class of uncoupled dynamics studied by Hart and Mas-Colell [9]. 

6.3. One example of a composite potential game. 

Consider a composite congestion game, with three categories of participants i € I = I\ U I 2 U I 3 , 
of weight m* each, taking place in a network composed of two nodes o and d connected by a finite 
set A of parallel arcs. 

Denote by s = ( s k )k£i 3 G S3 = A 13 a pure strategy profile of participants in I3 and let 
z = ((**) ie/j, (aV)j g / 2 , (s k )k£i 3 ). Let I{z) be the aggregate flow induced by the pure-strategy 
profile z. Namely: f a (z) = T,ieh + Sje / 2 + Sfce/ 3 mfcl {A=a}- 
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Figure 1. Example of a composite potential game 

ii(-) 



Theorem 6.1. Assume that for all a € A, the per-unit cost function is affine, i.e. Z n (m) = 
b a m + d a , with b a > 0 and d a > 0. Then a composite congestion game in this network is a 
potential game. 

A potential function defined on X is given by: 


W{x) 


Y ( n x %){\Y ba i ( ia ^ 2 + + Y( m Y t {° k =a}\ + Y daia ( z ">}’ 

seS 3 kei 3 aeA jei 2 kei 3 aeA 


( 21 ) 


with /i®(x) = to® for all i G I = I\ U I 2 U I 3 and all x G X. 

Proof. First notice that function W defined in (1211) is the multilinear extension of the following 
function defined on Z, the set of pure-strategy profiles: 


W(z) = --Y^ba[(Uz)f 


a&A 


+ E< 

j&h 


m 3 x 3 a ) 2 + J 2 
kei 3 


(m k )H 


{s fc =a}] d~ ^ ^ d a f a (z). 

aeA 


The per-unit cost to take arc a when the pure-strategy profile is 2 is c a (z) = b a { a (z) + d a , for 
all arc a G A. Recall that this is the opposite of the evaluation for the nonatomic players in 
population i G I\: & l a {z) = —c a (z). On the other hand, 

- • 2 ^a(z) • TO® + d a m l = TO® [& 0 f 0 (.z) + d a ] = m l c a {z). (22) 

For an atomic splittable player j G I 2 , when the pure-strategy profile is z, the cost is u J (z ) = 
YlaeA x a [ h aia{z) + d a ]. Therefore, 


dui (z) 
dx 3 a 


bJa{z ) + d a + b a m j x j a 


-Hi*)- 


On the other hand, 


dW(z) 1 


diP(z) 


dx J a 


— = -b a [2m. J { a {z) + 2(m :, ) 2 x 3 a ] +d a m J = m 3 [b a i a {z) + b a m 3 x 3 a + d a ] = m 3 7 . (23) 


dx 3 a 


Finally, for an atomic non splittable player k £ 1%, the cost to take arc a when the other players 
play z~ k is u k (z~ k ,a) = b a f a (z ~ k , a) + d a = On the one hand, 


u k {z k , a) — u k (z k ,r) = [b a f a (z k ,a) + d a ] - [b r i r (z k ,r) + d r }. 
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On the other hand, 

W(z~ k ,r) -W(z~ k ,a) 

= ’ a )) 2 + x 3 p f] +J2 d P { p( z ~ k ,a) + \[b a (jn k ) 2 + b s'( ml ) 2 } 

peA jeh p&A i&h\{k} 


fc ’ r )) 2 + X^ 777 ^) 2 ] _ ^2 d p f p( z V)- 

pgA jeh p&a 

= Y1 \^(?p( z ~ k i a )) 2 + d p i p (z~ k ,a) ~ ^(fp(^ fc ,r)) 2 

pG{a,r} 

= y[f (a (z“ A: ,a)] 2 + d a f a (z _fc ,a) - y[f a (z' fc ,a) - m fc ] 2 - 

+ y [f r (z _fc ,r) - m fe ] 2 + d r [f r (z~ k ,r ) - m fc ] - ^[f r (z _A: , 

= m fc [6 a f a (^ _fe ,a) + d a ] - m k [b r f r (z~ k , r) + d r \. 

Thus 


i[Mm*) 2 + E M™') 2 ] 

JeMW 



b a {m k ) 2 
+ 2 


b r (m k ) 2 

2 


da [fa(-2 fc , a) — m fc ] + 
r)] 2 - d r i r (z~ k ,r) - 


b a (m k ) 2 

2 

b r {m k ) 2 
2 


r) - TT(z- fe , a) = m fc [« fe (*- fe , a) - u fc (z“ fc , r)]. (24) 

By a multilinear extension with respect to z, (1221) (1241) imply (1201) . □ 

One can verify that the potential function W is concave on X. Therefore, x G X is a composite 
equilibrium of this composite congestion game if and only if it is a global maximizer of the potential 
function W. 

Concerning the dynamics in this congestion game, note that Proposition 16.31 applies. 


7. Conclusion 

This paper first describes three frameworks with distinct categories of participants: nonatomic 
populations, atomic splittable and atomic non splittable players, then introduces a class of games 
called composite games where the three categories coexist. We show that the static properties 
of the equilibria such as its characterization via variational inequalities, some conditions for the 
dynamics studied such as positive correlation, and the notion of potential games and dissipative 
games as well as their properties can be extended to composite games. In particular, the unilateral 
property of the dynamics and that of the positive correlation condition allow the dynamical system 
to converge when different participants follow different dynamics in a composite game. 

As a matter of fact, one can further define a more general category of atomic players, called 
composite players. A composite player of weight m l is described by the splittable component 
of weight m l ’° and the non splittable components of weight m 1 ' 1 hence represented by a vector 
777 * = (rri 1 ’ 0 , m 1 ’ 1 ,... ,771*’”’), where n l € IN*, m i '° > 0, m l,i > 0 and m*’° + E"=i m 1 ’ 1 = m l . Player 
i may allocate proportions of the splittable component to different choices and also allocate 
different non splittable components to different choices. However, a non splittable component 
cannot be divided. 

Equilibria and dynamics in this set-up will be studied in a forthcoming work. 


Appendix 

Proof of Proposition |^.5[ For a trajectory of dynamics x = £>$(x) with initial point xo, 

^ (x t ) = (VH(x t ),x t ) = (VH(x t ),B$(x t )) = 

iei 

Hence we focus on (S7H(xt),B$(xt)). The subscript for time t is omitted. 

(1) RD: Given an equilibrium x*, define H(x) = E ? ; a h^x 1 ) with /iV) = E pe sup P (P*) x p ln 5r- 
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H has a strict local minimum at x*. In fact, consider the neighborhood of x* in X defined by 
V = {x £ X, supp(.x*) C supp(x)}. The concavity of lnx and Jensen’s inequality imply: 


h‘(x‘) = - ]T 


xl* In — > — In ( 

P £l* — v 

pGsupp(ai 1 *) ^ pEsupp(:c 1 *) 


E x p ^ “ ln ( E 4 )=°’ 

P p€supp(a:) 


and the equality in both inequalities holds if and only if x l = x l *. 
Consider a trajectory of the RD dynamics with initial point xq £ V. 

x ®* 

(VH{x),B*(x)) = -J 2 E ~$T x pW x ) - 

i£l pGsupp(cc 4 *) ^ 

= E^ x * — ^*(®)) = ( x — x*, 3>(cc)). 

iei 


For x / x*, since r(3>) is dissipative (resp. strictly dissipative), one has (x — x*,&(x) — 
$(x*)) < (resp. <) 0 , which implies that (x — x*,$(x)) < (resp. <) (x — x*,<h(x*)) < 0 , 
i.e. (VH(x), £>$(x)) < (resp. <) 0. 

Therefore, FI is a local Lyapunov function when r(3>) is dissipative. If T($) is strictly dissipa¬ 
tive, then x* is the unique equilibrium, and IF is a strict local Lyapunov function. 

This result is given by Hofbauer and Sandholm m for population games. 


(2) BNN: H(x) = ± ■ 


(VH(x),£*(x)> = EEi[ E 


i-j 

■bq. 


jel q&Si 


iei,pes i 


For i = j. 


^ w = = 2 %( X ) [gr* i p (x) - ( X \ £n x )) - 


and for i 7 I j. 

Thus, 




(VF(i),B$(i)) = EEEE [«;<*>-4 E#<- 

jel q&Si iei pGS i 


® . < 1 > (x)x^ 
dx J q P { ' >' 1 


rGS* 

- E [ E IE Lp>4] 

iei pes i qes i 

(£„(*), Mx)B*{x)) - E [ E *?(*)] mx),Bi{x)). 

iei pes i 


Since B${x) £ Tx{x) and r(3>) is dissipative, (B$(x), J$(x)B$(x)) < 0. Because BNN dynamics 
satisfies (PC), ($ l (x), B$(x)) > 0 for x such that B$(x) / 0, hence (VFI(x), £><j>(x)) < 0 and the 
equality holds if and only if B$(x) = 0. 

Therefore, H is a strict Lyapunov function. 

It is clear that H(x ) > 0 and the equality holds if and only if for all i £ I and all p £ S l , 
& p (x) = 0, i.e. x £ NE(' F). 

This result is proved by Smith Isa m\ in a more general version and by Hofbauer im for 
one-population games. 

(3) Smith: H{x) = E ie / Ep^es* xt P {[^ q ( x ) ~ %( x )} + ) 2 - 
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One has: 

dH(x) 


air - E an - nn + e {E *? E 2 m - ni + (^ - 

geS i jei lesi q&Si 

= E an - ni + ) 2 + 2 E E {E AH - ni + - < E in - 

ge5 i j&I qeSi l£Si l£Si 

d$>{ 

i 
V 


Ean-ni + ) 2 +2EEns- 

ges* jei qcsi 


It follows that: 


(VH(x),B$(x)) = A + 2(£>$(x), J$(x)B$(x)), 

where: 

j=ee an - m + ) 2 n 

i£l p,qeS i 

= E E ([$*-$y+) 2 { ^-$?]+- 4 -$y + } 

*e/ p.ggS 4 iGS i ZgS* 

=E E nin-nnan-nrf-an-nm. 

i&i 

Recall that B$(x) £ Tx(x), thus (B$(x), Jf(x)B$(x)) < 0 since r(<f>) is dissipative. Also notice 
that if - <3?p > 0, then <& q — <& l p > <f>* — <f>J and thus [<h* — < hp] + > [<& l q — < h;] + . As a consequence, 
each term in A is non positive. By taking only the terms such that q = l, one obtains: 

(VH(x),B*(x))<~Y Y, 4«*Kz) - 4(*)] + ) 3 < o. 

i&I p,l,q£S l 

In addition, (VH(x),B$(x)) = 0 if and only if for all i £ I and all p £ S l , either x l p = 0 or 
<Lp(x) > <&\(x) for all l £ S 1 -, equivalently £>$( 2 ) = 0. 

Therefore, H is a strict Lyapunov function. 

Clearly, H(x) > 0. And the equality holds if and only if for all i £ I and all q £ S\ either 
x l q = 0 or <bg(x) > <3T(x) for all p £ S z ] equivalently, x £ NE{ <3?). 

This result is proved by Smith |28j in one-population setting. 

(4) LP: Given an equilibrium x *, let H(x) = ^||x — x*|| J . 

Recall that for all x £ X, x* — x £ T\(x), thus (x* — x, Ily^.(^[^(x)]) < 0. Then: 

<Vtf(x),B*(x)> = £>* -^n^^Xx)]) = (x-x'.II^^x)]) 

ig/ 

= (x-x*,<S>(x) - 11^(3) [$(x)]) = (x-x*,$(x)) - (x -X*, 11 ^(3.) [$(x)]) 

< (x — x *, 3>(x) — 3>(x*)) + (x — x*, 3>(x*)) < 0, 

because T(4>) is dissipative and x* is an equilibrium. Besides, when r(<h) is strictly dissipative, 
the equality holds if and only if x = x* : the unique equilibrium. 

Therefore, H is a global Lyapunov function when F is dissipative. In addition, H is a global 
strict Lyapunov function when T(<h) is strictly dissipative. 

This result is proved by Nagurney and Zhang [18] in one-population setting. 

(5) GP: H(x) = sup yeX L(x,y) with L(x,y) = (y - z,$(x)) - \\\y - x|| 2 , for x,y £ X. 

Since: 

II V ~ (x + $(x))|| 2 = ||y - x|| 2 + ||^(x)|| 2 - 2 (y - x, $(x)), 
one has H{x) = L(x,y*(x)) with y*(x) = IIv(x + 3>(x)). By the Envelope theorem: 

Vif(x) = W x L(x,y*(x)) = -$(x) + (y*(x) - x)(JJ(x) + I) 
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so that: 

(VH(x),B<s>(x)) = (-$(x) + (y*(x) - x)(Jj(x) + I),y*(x) - x) 

= (( x + $(x)) - Iix{x + <h(x)),x - IIx(a: + 3>(x))) + {B$(x), J$(x)H$(x)) < 0. 

The hrst term is negative by property of II_y- The second term is negative because T(<h) is 
dissipative. 

Therefore, H is a global Lyapunov function. 

Note that H is a global strict Lyapunov function when T(<f>) is strictly dissipative. 

Finally, 

H(x) = (II x (r + <L(x)) - x, <3?(x)) - 3 ||ILy(£ + <£>(x)) - x\\ 2 

= |||<h(x)|| 2 - l\\U x (x + <f>(x)) - (x + ^(x))|| 2 

= \\\{x + <3?(x)) - x|| 2 - |||(x + <f>(x)) - IIx(x + $(x))|| 2 > 0. 

The inequality is due to the definition of projection ILjy , and the equality holds if and only if 
x = + <L(x)), i.e. x G NE(< f>). 

This result is proved by Pappalardo and Passacantando [20] in one-population setting. 

(6) BR: H(x) = sup, yGX M(x, y) with M(x, y) = (y — x, 3>(x)), for x, y G X. 

Let H(x) = M(x, y(x)) with y(x) € BR{x). By the Envelope theorem, for any y(x), 

VH(x) = V x M(x,y(x)) = -$(x) + (y(x) -x)JJ(x) 

Hence, 

(VH,B^(x)) = (-$(x) + (y(x) - x)JJ(x),y(x) - x) = -H(x) + (S$(x), J^(x)B^(x)) < 0. 

The second term is negative because T($) is dissipative. Then the equality holds if and only if 
H(x) = 0 or, equivalently, x G A r E(<f>). 

Therefore H is a strict Lyapunov function. 

This result is proven by Hofbauer and Sandholm |12| for population games. □ 
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